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Abstract 

We formulate incomplete classical statistics for situations where the knowl- 
edge about the probability distribution outside a local region is limited. The 
information needed to compute expectation values of local observables can be 
collected in a quantum mechanical state vector, whereas further statistical in- 
formation about the probability distribution outside the local region becomes 
irrelevant. The translation of the available information between neighboring 
local regions is expressed by a Hamilton operator. A quantum mechanical op- 
erator can be associated to each local observable, such that expectation values 
of "classical" observables can be computed by the usual quantum mechanical 
rules. The requirement that correlation functions should respect equivalence 
relations for local obeservables induces a non-commutative product in classi- 
cal statistics, in complete correspondence to the quantum mechanical operator 
product. We also discuss the issue of interference and the complex structure 
of quantum mechanics within our classical statistical setting. 
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1 Incomplete classical statistics 



Following Einstein, Rosen and Podolski [1], many physicists have asked if it could 
be possible to derive quantum mechanics from an underlying classical statistical sys- 
tem. The motivation is to find an explanation of the "why" of the basic principles of 
quantum mechanics like the formulation in terms of states and non-commuting oper- 
ators, the superposition of "probability amplitudes" and the associated interference 
effects. Such a derivation from an underlying theory could also open the way to pos- 
sible generalizations of quantum mechanics and to the formulation of further tests 
of its basic principles [2], [3]. For a large class of classical statistical systems with 
certain locality properties it has been shown [4] that classical and quantum statistics 
lead to a different behavior of measurable correlation functions. The experimental 
verification of the predictions of quantum mechanics is unequivocal. Any attempt to 
derive quantum mechanics from classical statistics has therefore to circumvent the 
assumptions of Bell's inequalities for the classical system and should reproduce the 
predictions from quantum mechanical interference. Our formulation of incomplete 
classical statistics with infinitely many degrees of freedom is of this type. 

The understanding of classical statistical systems with infinitely many degrees 
of freedom has made tremendous progress in the past decades. Important links 
to quantum mechanics have been established by the use of path integrals [5] for 
the description of the quantum mechanical evolution. This process has diminished 
considerably the distance between classical statistics and quantum mechanics or 
quantum field theory [6] . One wonders if quantum mechanics cannot be understood 
as a particular structure of classical statistical systems with infinitely many degrees 
of freedom or, in other words, if it can be derived from general statistics [7]. Within 
general statistics the notions of distance, geometry and topology have already been 
formulated in terms of properties of correlation functions [8]. The question arises if 
the notions of time and quantum mechanical evolution can find their origin within 
the same framework. 

The formulation of the basic partition function for classical statistical systems 
with infinitely many degrees of freedom uses implicitly an assumption of "complete- 
ness of the statistical information". This means that we assign a probability to 
everyone of the infinitely many configurations. The specification of the probability 
distribution contains therefore an "infinite amount of information". This contrasts 
with the simple observation that only a finite amount of information is available in 
practice for the computation of the outcome of any physical measurement. A con- 
centration on measurable quantities suggests that the assumption of completeness 
of the statistical information may have to be abandoned. In this note we explore 
consequences of "incomplete statistics" which deals with situations where only par- 
tial information about the probability distribution is available. In particular, we 
consider extended systems for which only local information about the probability 
distribution is given. We will see that the quantum mechanical concepts of states, 
operators, evolution and interference emerge naturally in this setting. 
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The outcome of the present work is still far from reaching a stage where quan- 
tum mechanics can be derived from a classical statistical setting. The main obstacle 
remains the characteristic complex structure of quantum mechanics which is not 
yet implemented in a satisfactory way. Nevertheless, we find it interesting to ob- 
serve how other structures which were believed to be characteristic for quantum 
mechanics, like a non-commutative product or the effect of interference, are actually 
already present in classical statistics. The formulation of incomplete statistics will 
be very useful in order to motivate how the quantum mechanical structures arise 
naturally in classical statistics. The notion of incompleteness is, however, not crucial 
for the existence of these structures. Quantum mechanical structures are present in 
"standard" (complete) classical statistics as well. 

As an example, let us consider a classical statistical system where the infinitely 
many degrees of freedom {n e are ordered in an infinite chain. We con- 
centrate on a "local region" |77,| < n and assume that the probability distribution 
p[(f>] has a "locality property" in the sense that the relative probabilities for any 
two configurations of the "local variables" ipn are independent of the values that 
take the "external variables" ipra with \m\ > n. Furthermore, we assume that the 
probability distribution for the is known for given values of the variables ipn, ip-n 
at the border of the local interval. As an example, we may consider a probability 
distribution 



where p> and p< are only constrained by the overall normalization of p[ip\ and we 
will consider the limit e ^ 0. This statistical system cannot be reduced to a system 
with a finite number of degrees of freedom since the probability for the occurrence 
of specific values of the "border variables" ip^, ip^n depends on the values of the 
external variables and their probability distribution. The statistical information 
about this system is incomplete since we will not specify the probability distribution 
p>p< for the external variables completely. 

Local observables are constructed from the local variables ipn. As usual, their 
expectation values are computed by "functional integrals" where the probability 
distribution p[(p\ appears as a weight factor. Incomplete statistics deal with the 
expectation values of local observables. Thereby the questions that may be asked 
reflect the incompleteness of the statistical information. As a flrst question, we ask 
what are the conditions on p>p< which lead to n-independent expectation values 
< ip'P{h) > for all or some integer values of p? Furthermore, are there any restric- 
tions on the allowed values of n-independent expectation values < ip^{n) >? The 
answer to these questions, given in sect. 4, may surprise: indeed, probability dis- 
tributions p>,p< that are consistent with n-independcnt < ip^{n) > are possible 
only for certain discrete values for < ipP{n) >. These values correspond precisely 



PM = P>[Vm>n]Po[^-n<h<n]P<[^m<-n] { 
r 1 \ ^22 4 / \2 / \2 

Pom = exp<^-2_^ -fnpf^ + -X(pf^ + —{(pfi-ipf^_i) - —{(pfi - ipfi^i) 



(1.1) 
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to the expectation values of the operators in the stationary states of quantum 
mechanics. Here our example (1.1) corresponds to a one-dimensional particle with 
mass M in an unharmonic potential V{Q) = + f Q^- The appearance of the 
quantum-mechanical discreteness in a classical statistical system is striking and we 
will attempt to understand its origin and the deep connection to quantum mechanics 
in more detail in this note. 

We next ask more generally what is the minimal amount of information about 
the probability distribution for the external variables (pm which is necessary for a 
computation of expectation values of local observables. One finds that this infor- 
mation can be summarized in "states" {ip}, {ipl that can be represented as ordinary 
functions {■(/'(v^n)|, \ip{ip-n)}- Since these functions depend each only on one vari- 
able, the specification of the states contains much less information than the full 
probability distribution p>p< which depends on infinitely many variables (pjn>n, 
Vm<-n- The states contain the minimal information for "local questions" and are 
therefore the appropriate quantities for our formulation of incomplete statistics. We 
will see in sect. 7 that any further information about the probability distributions 
P>['~Prn\-iP<['~Prn\ bcyoud the one contained in the state vectors is actually irrelevant 
for the computation of expectation values of local observables. 

The expectation values of all local observables can be computed from the know- 
ledge of the local probability distribution and the states I?/'} and {■?/'|. For this 
computation one associates to every local observable A[ip\ an appropriate operator 
A and finds the prescription familiar from quantum mechanics 

{AM) = {V^|i|^} (1.2) 

There is a unique mapping A[ip] — > A for every local observable which can be 

expressed in terms of an appropriate functional integral. Wc find that for simple 
observables A[ip\ the operators A correspond precisely to familiar operators in quan- 
tum mechanics. For example, the observable (p{n) can be associated to the operator 
Q{t) in the Heisenberg picture where time is analytically continued, r = it, and 
n — r/e. 

Local correlation functions involving derivatives may be ambiguous in the con- 
tinuum limit. This problem is well known in functional integral formulations of 
quantum field theories. We show how to avoid this problem by defining correlations 
in terms of equivalence classes of observables. In fact, two observables 74i[93], 742[93] 
can sometimes be represented by the same operator A. In this case Ai[ip] and A2[</?] 
are equivalent since they cannot be distinguished by their expectation values for 
arbitrary states. They have the same expectation values for all possible probability 
distributions. We define a product between equivalence classes of observables which 
can be associated to the product of operators. For example, we associate to a corre- 
lation ip{n\) o </?(fi2) the product Q{ti)Q{t2) which is not commutative. It is again 
striking how the non-commutativity of quantum mechanics arises directly from the 
question what are meaningful correlation functions in incomplete statistics! Indeed, 
equivalent observables should lead to equivalent correlations. We will see (sect. 6) 
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that this points to a non-commutative definition of the correlation v^(ni) o 93(712) • 
In sect. 7 we argue that the "quantum correlation" based on o (^2 can actually 
be formulated quite generally in classical statistics (not necessarily incomplete) and 
has better "robustness properties" as compared to the usual classical correlation. 

We also may ask what can be learned for expectation values like < ip^{n) > if 
the states are specified by a sufficient number of expectation values at some given 
location no (e.g. < ^^{ho) >, < {(p{no + l)—(p{ho)y' > etc.). We find that operators 
and states can be transported from one site to the next by an evolution operator 
U in complete analogy to quantum mechanics. This introduces once more a crucial 
concept of quantum mechanics in the formulation of incomplete statistics, namely 
the Hamilton operator. As one may expect, it corresponds to the transfer matrix in 
classical statistics. 

Finally, we ask in sect. 8 if the characteristic interference of quantum me- 
chanics also finds its equivalent in incomplete statistics. We explicitly construct 
classical probability distributions that correspond to linear superpositions of states 
(^ilipi} + C(2\'4'2} and show the corresponding interference behavior. We also describe 
probability distributions leading to a formulation in terms of density matrices that 
do not correspond to pure states. We conclude in sect. 9 that many fundamental 
features of quantum mechanics are shown to arise directly from the formulation of 
incomplete statistics. Inverting our procedure we find quantum mechanical states 
which admit a functional integral description. This goes beyond the usual descrip- 
tion of the vacuum or thermal equilibrium state. 

There remains one crucial feature of quantum mechanics, namely its complex 
structure or the issue of "phases", that has not yet emerged in a satisfactory way 
from classical statistics. It is closely related to the difference between "real time" 
in quantum mechanics and "Euclidean time" in classical statistics or the issue of 
analytical continuation. We describe our (incomplete) attempts in this direction 
in two appendices. The invariance of the probability distribution under a reflection 
(fin <f-n can be associated with a complex structure. With respect to this complex 
structure all quantities that are odd under reflections become purely imaginary. 
Then the evolution operators U are unitary and {ipl is complex conjugate to {ip}. 
Also r = en is imaginary. It is not clear, however, how the state vectors as functions 
of (pn (at flxed n) should be analytically continued without loosing the probability 
interpretation of the functional integral. 



2 States and operators 

Consider a discrete ordered set of continuous variables (pn = t = ^n, n G 

Z and a normalized probability distribution p{{pn}) = p[<^] = exp(— 5'[(^]) with 
J D(pe~^^'^^ = Yinil^oo^^^^Pl-^^ ^ ^^^^ assume that the action S is local in a 
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range — r < r < r, i.e. 



S = -\np = J dT'C{T')+Sy{f) + S4-f) 
C{t') = V{^{T')y) + \z{T'){dMr')f 



(2.1) 



Here we have used a continuum notation (ni,2 = ^1,2/^) which can be translated into 
a discrete language by 

Jti . „. , 1 ^ 



+ - 



^n2 



n=ni+l 

2 / \ 2 



(2.2) 



with 



This corresponds to a discrete derivative 



(2.3) 



{dMr)Y = 2 



2 1 I V5(^ + e) - <^(t) \ V / <^('r) - <^(t - e) ^ ^ 



+ 



2e2 



(2.4) 



The boundary terms in eq. (2.2) are chosen such that S^{f) is independent of all 
^{t') with t' < f whereas 5'<(— f) only depends on Lp{r' < —f). Except for the 
overall normalization of p no additional assumptions about the form of Sy (f) and 
5'<(— f ) will be made. In case of 5" being local also at f we note that S>{f) contains 

a term f [^^((^(f ), f ) + l^(^(f + e), f + e)] + |(Z(f ) + Z(f + e)) (^Ml±£lz^j', which 

involves a product <^(r + ^)^{t) and therefore links the variables with r > f to the 
ones with t <f. 

We are interested in local observables A[(/7;r] which depend only on those </?(r') 



where r 



expectation value of A is 



< r' < r + |. (We assume — r < r — |, r > r + |.) As usual, the 



< A{t) >= J D(pA[ip; 



Tie 



(2.5) 



As mentioned in the introduction, our investigation concerns the question what we 
can learn about expectation values of local observables and suitable products thereof 
in a situation where we have no or only partial information about S^{f) and S'<(— f). 
It seems obvious that the full information contained in S is not needed if only 
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expectation values of local observables of the type (2.5) are to be computed. On the 
other hand, < A{t) > cannot be completely independent of 5'>(f ) and 5'<(— f) since 
the next neighbor interactions (2.2) relate "local variables" (p{r — | <t'<t + |) 
to the "exterior variables" (f{r' > f) and </7(r' < —f). 

In order to establish the necessary amount of information needed from <S'>(f) 
and 5'<(— f) we first extend and 5'< to values |t| < f 

S<{n) = S^-f) + r dr'Cir') , 5>(r2) = 5>(f) + r dr'Cir') (2.6) 

J —T J T2 

where we note the general identity 

S^{t) + S^{t) = S (2.7) 
The expectation value (2.5) can be written as 

A{t) J d^{T +^-)J d^{T i)(^(,,>,^.)e-^>(^+i) (2.8) 

D(p^^_s^^,^^^^A[lp^,r]ex.p{- J ^ dr" C{t")} J D(p^^,^^_^^e- 



< 



I 



-S<(T-f) 



, e-s<ir-l) 

'<T-lf 



This suggests the introduction of the "states" 

m^pir + ^); r + ^)| = J D^(,,>,^.)e-^>(-+i) (2.9) 

and the operator 



= J i^^(,_|<,,<,+|)^b; T]exp|-^^'^'rfT"£(r")| (2.10) 

We note that {ip} is a function of ip{T — |) since the latter appears in 5'<(r — |) and 
is not included in the ("functional") integration (2.9). Similarly, {ipl depends on 
<^(t + |) whereas ^4 is a function of the two variables (^(r + |) and (^(r — |). Using 
a notation where and are interpreted as (infinite dimensional) vectors and 
A as a matrix, one has 

<A{t) >= {^(r+^)i5(r)V^(r-^)} 

/r s 5 

dip2 / dcpi{ijj{ip2;T + -)\As{ip2,ipi;T)\ip{(pi;T - -)} (2.11) 
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This form resembles already the well-known prescription for expectation values of 
operators in quantum mechanics. In contrast to quantum mechanics eq. (2.11) still 
involves, however, two different state vectors. 

The mapping A[lp; t] — >■ As{t) can be computed (cf. eq. (2.10)) if C{t') is 
known for |r'| < f. The only information needed from 5'>(f) and S'<(— f) is there- 
fore contained in the two functions {ijj{ip)\ and |'?/'((/9)}! The specification of these 
states (wave functions) at f and — f and of >C(|r| < f) completely determines the 
expectation values of all local observables! 

Wc will see below the close connection to the states in quantum mechanics. In 
our context we emphasize that for any given S these states can be computed as well 
defined functional integrals (2.9). Due to eq. (2.7) they obey the normalization 

{V'(t)V(t)} = J dcp{^{ip;T)Mip;T)} = 1 (2.12) 

Incomplete statistics explores statements that can be made for local observables and 
appropriate products thereof without using information about S> or 5'< beyond the 
one contained in the states l'^} and 



3 Evolution in Euclidean time 

For a "locality interval" 6 > the expression (2.11)) involves states at different 
locations or "Euclidean times" t -|- | and t — |. We aim for a formulation where 
only states at the same r appear. We therefore need the explicit mapping from 
|'0(t — |)} to a reference point \'il^{r)} and similar for {■?/'(t + |)|- This mapping 
should also map As to a suitable operator such that the structure (2.11) remains 
preserved. The dependence of states and operators on the Euclidean time r is 
described by evolution operators (t2 > ri, T2 > Tf, Ti > Ti,Tf = t + ^, = r — |)) 

|V'(t2)} = ^7(t2,Ti)|V'(Ti)} 

{Hn)\ = {i;{T2)\U{T2,n) 

A(t2, Tl) = t/(T2, rf)A{rf, n)U{n, n) (3.1) 

or differential operator equations (e — > 0); 

dr\ij{r)} = -H{TM{T)} 
5r{^(r)| = {^(r)|^(r) ^ 

d-riAs{Tf,Ti) = As{Tf,Ti)H{Ti) 

dr^AsiTf,T,) = -H{Tf)As{Tf.T,). (3.2) 

The evolution operator has an explicit representation as a functional integral 



U{^p{t2), (p{ti); T2, Tl) = J Dcp(^ri<T'<r2) | ~ / d^" ^'t")^ 



(3.3) 
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and obeys the composition property (ra > T2 > ti) 

U{r3,r2)U{T2,n)^U{Ts,n) (3.4) 

with 

U{(P2,(Pi;t,t) = S{ip2- ^1) (3.5) 

It can therefore be composed as a product of transfer matrices or "infinitesimal" 
evolution operators 

C/(r + e,T) =e-^^(^+t) (3.6) 

In case of translation symmetry for the local part of the probability distribution, 
i. e. for V and Z independent of r, we note the symmetry in (pi <-> (p2 

U(r + e,r) = U^{r + 6, r) , H{t + |) = H^{t + ^) = H (3.7) 

In this case the real symmetric matrix H has real eigenvalues E^- Then the general 
solution of the differential equation (3.2) may be written in the form 

mr)} = ^^"^e-^'^^ {^|;{T)\ = J^^^e^-^^ (3.8) 

n n 

where ijj^^ and 'i/'o"^ are eigenvectors of H with eigenvalues En- Here we recall that 
the construction (2.9) implies that and {ipl are real positive functions of </? for 
every r. This restricts the allowed values of the coefficients V'o"'' ) ^0"^ • 

We next want to compute the explicit form of the Hamilton operator H. It is 
fixed uniquely by the functional integral representation (3.3) for U. In order to 
obey the defining equation (3.6), the Hamilton operator H must fulfill for arbitrary 
\ip{(p)} the relation (with Z = Z(t + f ) = |(Z(t + e) + Z{t)) 

J ci(^i^((^2,¥'i)|'0(¥'i)} = -lim^l J dipi (3.9) 

\^M}-m^2)}} 



exp 



~ivM + v{ip,))-^^{iP2-ip^f 



The solution of this equation can be expressed in terms of the operators 

Q{(f2, (fl) = (flS{(fi2 - <fl) 



q2 

p2(<^2,¥'i) = -%2-^i)^ (3.10) 

as 

^(r) = n4r) + ^P^ (3.11) 
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This can be established^ by using under the <^i-integral the replacement 



e-.i«-.. ,(^,_^0axp^5^g^j (3.12) 

which is valid by partial integration if the integrand decays fast enough for |<^i | — > oo. 
We note that the operators Q and do not commute, e.g. 

[P^Q]((^2,¥^l) = -2%2 - Vi)^ (3.13) 

The Hamilton operator can be used in order to establish the existence of the 
inverse of the "infinitesimal" evolution operator, ?7~^(T + e, r) = e^^*^^"^^-*. Then 
the inverse C/~^(r2,ri) is defined by the multiphcation of "infinitesimal" inverse 
evolution operators, and we can extend the composition property (3.4) to arbitrary 
T be defining for T2 < t\ 

U{T2,n) = U-\n,T2) (3.14) 

(For a given dependence of U on the variables T2 and Ti the matrix U{ti, T2) obtains 
from f/(r2,ri) by a simple exchange of the arguments ti and T2-) Using eq. (3.1), 
this allows us to write the expectation value of a local observable in a form involving 
states at the same r- variable 

< A{t) >= {V'(t)C/(t, t + ^-)As{t)U{t - ^, t)V'(t)} (3.15) 

4 Stationary observables 

At this point we can already answer the question posed in the introduction: What 
are the conditions for the expectation values 97^ (r) to be r-independent for all p or 
some given pi Since the observables </7(t) have support only at one point r, we can 
choose 5 — Q such that 

< ^{t) >= mrmir)} = J dip{^{^;T)\^P\^{^;T)} (4.1) 

Using the explicit solution of the evolution equation (3.8), this yields for translation 
symmetric V and Z 



< 



(^(r) >= J d(^^a„Xn(¥')e^"Ve-^"'X'Xn'(¥') (4.2) 



^The Hamilton operator can also be defined for small nonzero e where one has e = 
(^)^^%-4^('3,T+e)g-ePV2Ze-f^(<3.^). We have absorbed the prefactor by a constant shift 
in V, i.e. V ^ V — fjln^. If appropriate, one may use the symmetric form where 
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where the functions Xn{^) are an orthonormal set of basis vectors. We choose them 
to be eigenfunctions of the Hamiltonian 

HXni^p) = Er^Xni^) (4.3) 

where H is interpreted as a differential operator which takes ior Z — M the famihar 
form 

We speciahze to V{ip) = l/^^^?^ + A > 0, which corresponds to an unharmonic 

oscillator (cf. eq. (1.1)). The functions Xn{v) are, of course, precisely the stationary 
solutions of the Schrodinger equation for a particle in a one-dimensional potential 

Defining 

Kw = / dcpXn{v^)^'Xn'{v^) (4.5) 

one obtains 

< (^(r) «nan'i^L.e(^"-^"')- (4.6) 

n,n' 

An obvious solution for r-indepcndent expectation values < v'^(r) > are probability 
distributions for which nonvanishing only for one given value n = n'. 

Such distributions correspond precisely to the stationary pure states in the associ- 
ated quantum mechanical problem. Furthermore, the normalization (2.12) implies 
On^n = 1 and therefore 

< (/(r) (4.7) 

If the above solution is the only solution, we arrive at a simple, perhaps surpris- 
ing conclusion: The mere requirement of r-indcpcndcnt < ^p^ij) > associates the 
allowed probability distributions to stationary quantum states. Furthermore, the 
allowed values oi < (p^ > are discrete, reflecting the discreteness of the associate 
quantum mechanical problem! 

It remains to be shown that no other solutions exist with dr < P^{t) >= 0. If we 
require the r-indcpendence for < ip^^r) > for all p, this can be established in a rather 
straightforward way. Assume a„ 7^ for some n. If is nonvanishing for m 7^ n, 
the sum (4.6) contains a r-dependent contribution anamKP^exp{{En — Ejn)r} at 
least for certain values of p. (There is no superselection rule for the unharmonic 
oscillator. Therefore for any given pair (n, m) the integral K^^^ does not vanish 
for all p.) The above contribution to dr < V^^(t) > could only be cancelled by 
a similar contribution with the same r-dependence, whereby a„/ and a^' must be 
nonzero and — Em' = i?„ — E^,, with n' ^ n, m' ^ m. The spectrum of 
the unharmonic oscillator has no degeneracy - there is only one state for every 
eigenvalue En. The equality of two energy differences in the spectrum could occur 
accidentally for particular values of A. This is, however, not a problem for our 
argument since a cancellation of the term ~ expKE'^ — £'^)r} would only be possible 
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at the expense of new terms with a nontrivial r-dependence, i.e. ~ exp{{En— Em')T} 
and exp(£'„/ — Em)T. This problem will be continued if one tries further to cancel 
the new terms. Since equal energy differences can only occur accidently, one rapidly 
arrives at a contradiction since no pair with the required precise energy difference 
will be available any more. (A similar argument would not work so easily for the 
harmonic oscillator with its equidistant spectrum.) 

Finally, if we require r-dependence only for some values of p, the above argument 
will work only if for every pair (m, n) there exists a nonvanishing K'^^. Otherwise it 
is easy to construct a counterexample. Assume we consider only p = 2 and there is, 
perhaps accidentally, a pair (m, n) with K'^^^ — 0- Then a state |-?/'} ~ (o-rnXm+^nXn) 
and similar for leads also to r-independent values of < <^^(t) >. The discreteness 
of the allowed values of r-independent < </7^ > would be lost in this case. However, if 
a sufficient number of expectation values < </?^(r) > are required to be r-independent 
simultaneously, this possibility of accidentally vanishing matrix elements can be 
discarded. 

To conclude, the condition of r-independence of a suitable number of expectation 
values < </7^(r) > leaves only a discrete number of possibihties to continue the 
local probabihty distribution (1.1) outside the local region. Correspondingly, the 
allowed r-independent values < tp^ > are also discrete. They correspond to the 
stationary wave functions of the quantum mechanical unharmonic oscillator. Since, 
in addition, \il)[(p)} is real and positive one concludes that excited states with zeros 
of cannot be described in our setting. The ground state solution can be 

realized by extending the translation symmetry of po also to p> and p<, but also 
by all other p> and p< which lead to the same state vectors and We have 
seen that the simple question of r-independence of expectation values has led us 
directly to the appearance of quantum mechanical concepts like states and operators 
in our classical statistical setting. In the following we will exploit these quantum 
mechanical concepts to describe also r-dependent expectation values. This will give 
us a deeper insight how various quantum mechanical structures are rooted in our 
formulation of incomplete classical statistics. 



5 Schrodinger and Heisenberg operators 

In this section we want to exploit further the mapping between incomplete statistics 
and quantum mechanics for situations where expectation values like < ip{T) > may 
depend on r. A typical question one may ask within incomplete classical statistics 
is the following: Given a large set of measurements of observables with support at 
a given value r = 0, like < v^''(0) >, < {dr^p{0)y >, etc., what can one predict for 
the expectation values of similar observables at some other location r 7^ 0? It is 
obvious that the evolution operator t) is the appropriate tool to tackle this type of 
questions. 
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The existence of the inverse evolution operator allows us to associate to an ob- 
servable A{t) the operator As{t) in the Schrodinger representation (cf. eq. (3.15) 

As(r)^U{r,r+^-)As{r)U{r-^-,r) (5.1) 

The expectation value of the observable A can be expressed by the expectation value 
of the operator As in a way analogous to quantum mechanics 

< A{r) >= {V'(r)|i5(T)|V'(T)} = Trp{T)As{r) (5.2) 

For the second identity we have introduced the "density matrix" 

p{ipuf2,r) = |^(<^i,r}{^/.(<^2,r)| = y"D<^(rYr)e-^^^^''^^^ 

Trp(T) = 1 (5.3) 

where S{(f 1.(^2) obtains from 5" by replacing </?(r) — >■ (pi for all "kinetic" terms 
involving (/^(r' < r) and (/^(r) for those involving (p[r' > r), whereas for 

potential terms e^'^^^^^)' e-^2(v(^^)+^(^-^)) . 

In order to make the transition to the Heisenberg picture, we may select a refer- 
ence point T — and define 

U{t) = U{t, 0) , p = p(t - 0) , p(t) = U{t)pU-'{t) (5.4) 

This specifies the Heisenberg picture for the r-dependent operators 

Ah{t) = lf-\T)As{T)U{r) 
< A{t) > = TrpAniT) (5.5) 

We note that for two local observables Ai, A2 the linear combinations A — aiAi + 
OL2A2 are also local observables. The associated operators obey the same linear 
relations A = aiAi + 0:2^2, where A stands for As, As or A^. The relation (5.5) 
is the appropriate formula to answer the above question. One may use the set of 
measurements of expectation values at r = to gather information about p. Once 
p is determined with sufficient accuracy, the expectation values < A{t) > can be 
computed. Of course, this needs a computation of the explicit form of the Heisenberg 
operator Ah{t). 

It is instructive to observe that some simple local observables have an essentially 
T-independent operator representation in the Schrodinger picture. This is easily 
seen for observables A{t) which depend only on the variable (fiir). The mapping 

A{r) = /((^(r)) ^ As{t) = f{Q) (5.6) 



12 



For the derivative operator ((^^(^(t))^ a simple representation obtains in the hmit 

A{t) = {dMr)f^ 
As{t) - 1 1 



e\Z{T + e) + Z{T) Z{T-e) + Z{T) 



2 2 



[Z{T + e) + Z{T)f {Z{T-e) + Z{T)y 

-2/ ^ ei^(^'") e-i^(^'^)l 

l(Z(T + e)+Z(T))2'^ L '"^ J 

(Z(r-e) + Z(T))2 r '"^ J / ^ ^ 

The last term is ~ and for constant Z and e ^ one has 

{dMr)f - l/{eZ) - Pyz' (5.8) 

We observe that the r.h.s. of eq. (5.8) differs from —P'^/Z'^ by a constant which di- 
verges for e — > 0. This reconciles the positivity of {d-r^Y with positive ^ expectation 
values of P^. 

For the transition to the Heisenberg picture the explicit definitions (3.3) and 
(3.10) yield 

QU{t) = ip{T)U{T) , U{t)Q = ipmir) (5.9) 
and we note that the evolution operator does not commute with Q, 

[Q, U{t)] = ((^(r) - mPir) = {^2 - m)U{V2, Vi, r, 0) (5.10) 

Observables depending only on one variable 99 (r) have the Heisenberg representation 
(cf. eq(5.6)) 

A{t) = /((^(r)) ^ Ah{t) = U-\T)f{Q)U{T) = f{Q{T)) (5.11) 

Here we have used the definition 

Q{t) = U-\t)QU{t) (5.12) 

More generally, one finds for products of functions depending on the variables 
if{Ti),(p{T2)...(f{Tn) with Ti < T2 < ...T„ the Hciseuberg operator 

A(ri,...rn) = fl{^{Tl)f2{^{T2))...fn{^{Tn)) > 

Anir) = C/-'(Tn)/n(g)^7(T„,T„_i)...t/(T3,T2)/2(g)J7(T2,Ti)/i(Q)C/(Ti) 

= fn{Q{rn))...f2{Q{T2))fl{Q{n)) (5.13) 



^Note that is not necessarily positive as long as |V'(''')} and {■</'(''') | are unrelated. 
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This important relation follows directly from the definitions (2.10), (5.1), (5.5). We 
observe that Ah depends on the variables which are the arguments of A but shows 
no dependence on the reference point r. (Only As and As depend on r.) 

We can use eq. (5.13) to find easily the Heisenberg operators for observables 
involving "derivatives", e.g. 

A = dr(p{Ti) = ^{ip{Ti + e) - ifiin - e)) 
Ah = Ye^U-\n + e)QU{n + e)-U-\n-e)QU{n-e)} 

26 

= u-\n)[Hin),Q]U{n) + Oie) 



2^(ri) 



^ U-\n)RU{n) + 0(e) = --l-^(ri) + 0(e) (5.14) 



where we have assumed that H is a. smooth function of r. Here R is defined by 

R{^2: ^l) = 5{^2 -ipi)^, R^ = -P^ (5.15) 

and we use, similar to cq. (5.12), the definitions 

R{t) = IJ-\t)RU{t) , P^{t) = U-^{t)P^IJ{t) (5.16) 

Two different definitions of derivatives can lead to the same operator Ah- An 
example is the observable 

A = aXn) = ^((^(n + e) - (^(n)) (5.17) 

Up to terms of order e the associated Heisenberg operator is again given by Ah = 
—Z{ti)~^U~^{ti)RU{ti) and therefore the same as for dr^iri) (eq. (5.14)). Apply- 
ing the same procedure to the squared derivative observable (2.4) yields 

A = {dM\T,)^ 

Ah = ^^U-\T{){2e[Q,[H,Q]]+2^[Q,H][Q,H]}U{T{) 

where we have assumed for simplicity a r-independent Hamiltonian H. This is in 
agreement with the direct evaluation (5.8). It is remarkable that this operator differs 



14 



from the square of the Heisenberg operator associated to dr(p{Ti) by a constant which 
diverges for e — > 0. Indeed, one finds 

A = idMn)r ^ Ah ^ ^ - ^P\n) 

A ^ (d>cp{n)r^An^^-j-,P'{T^) (5.19) 

Incidentally, these relations can be used in order to find an observable whose Schrodinger 
operator is given by and Heisenberg operator by P^(r): 

Ap2{n) = Z\d>^{n)f-2Z\dMri)f 

= — {'^^(n) + ^{jx + e)(^(ri - e) - (^(ti + e)(^(ri) - (^(ri)(^(ri - e)} 

^An^ P\Tr) (5.20) 

As a last instructive example for the association between observables and Heisen- 
berg operators we consider (for e — > 0) 

A = 9Xti)(^(t2) ^ 



-Z-^R{ri)Q{r2) for n > T2 + e 
Ah = { (5.21) 

-Z-^Q{t2)R{ti) for Ti<T2-e 

The place were R and Q appear depends on the ordering of ri and T2. One obtains 
the same Heisenberg operator (5.21) if one replaces 5^(^(ri) by dr^p{Ti). On the 
other hand, for equal locations T2 = ti the two observables correspond to different 
Heisenberg operators 

^(n)d>^(n) ^ -Z-'U-\n)RQU(n) 
vinPMn) ^ ~z-'u-\n)iRQ + QR)Uin) 

^ _Z-'U-\ti)RQU{ti) + ^Z-' (5.22) 

One concludes that for arbitrary probability distributions p< and (or states 
and lip}) the expectation values < d^(p{Ti)(p{ri) > and < dr^p{ri)Lp(ri) > differ. 

Eqs. (5.19) and (5.22) teach us that the product of derivative observables with 
other observables can be ambiguous in the sense that the associated operator and 
expectation value depends very sensitively on the precise definition of the derivative. 
This ambiguity of the derivative observables in the continuum limit is an unpleasant 
feature for the formulation of correlation functions. In the next sections we will see 
how this problem is connected with the concept of quantum correlations. We will 
argue that the ambiguity in the classical correlation may be the basic ingredient 
why a description of our world in terms of quantum statistics is superior to the use 
of classical correlation functions. 



15 



6 Correlation functions in incomplete classical 
statistics 



A basic concept for any statistical description are correlation functions for a num- 
ber of observables 74i[<^], 742[9?]. ... In particular, a two-point function is given by 
the expectation value of an associative product of two observables Ai[Lp] and A2[v5]. 
For local observables Ai,A2 the product should again be a local observable which 
must be defined uniquely in terms of the definitions of Ai and A2. This require- 
ment, however, does not fix the definition of the correlation uniquely. The standard 
"classical product", i.e. the simple multiplication of the functionals Ai[ip] ■ 
(in the same sense as the "pointwise" multiplication of functions) fulfills the gen- 
eral requirements"^ for a correlation function. Other definitions can be conceived as 
well. In this section we will introduce a quantum correlation which equals the clas- 
sical ("pointwise") correlation only for r-ordered non-overlapping observables. In 
contrast, for two local observables with overlapping support we will find important 
differences between the quantum and classical correlation. In particular, we will 
discover the effects of the non-commutativity characteristic for quantum mechanics. 

Incomplete statistics draws our attention to an important issue in the formula- 
tion of meaningful correlation functions. Consider the two versions of the derivative 
observable and d^cp defined by eqs. (5.14) and (5.15), respectively. In the 
continuum limit (e 0) they are represented by the same operator Ah- In conse- 
quence, both definitions lead to the same expectation value for any state {ip}, {ipl- 
The two versions of derivative observables cannot be distinguished by any measure- 
ment and should therefore be identified. On the other hand, the classical products 
drfiTi) ■ 9,-</7(t2) and d^(p{Ti) • d^ip{T2) are represented by different operators for 
Ti = r2, as can be seen from eq. (5.19). (See also eq. (5.22) for a similar ar- 
gument involving dr^{Ti) ■ Lp{r2).) This means that the two versions of derivative 
observables lead to different classical correlation functions! Obviously, this situation 
is unsatisfactory since for e — > no difference between the two versions could be 
"measured" for the observables themselves. We find this disease unacceptable for a 
meaningful correlation and require as a criterion for a meaningful correlation func- 
tion that two observables which have the same expectation values for all (arbitrary) 
probability distributions should also have identical correlation functions. We have 
shown that two observables which are represented by the same Heisenberg operator 
have indeed the same expectation values for all possible probability distributions 
and should therefore be considered as equivalent. They should therefore lead to 
indistinguishable correlation functions. 

As we have already established, the two derivative observables Ai = dr^{r) and 
A2 = d^ifir) are indistinguishable in the continuum limit, whereas their classical 
correlations are not. We may therefore conclude ^ that the classical correlation 

*This holds provided that the product results in a meaningful observable with finite expectation 
value. 

^We will discuss in the next section to what extent this problem may be cured by a restriction 
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Ai ■ A2 is not a meaningful correlation function. In this section we propose the use 
of a different correlation based on a quantum product A10A2. By construction, this 
correlation will always obey our criterion of "robustness" with respect to the precise 
choice of the observables. It should therefore be considered as an interesting alter- 
native to the classical correlation. At this place we only note that the "robustness 
problem" is not necessarily connected to the continuum limit. The mismatch be- 
tween indistinguishable observables and distinguishable "classical" correlations can 
appear quite generally also for e > 0. 

Our formulation of a quantum correlation will be based on the concepts of equiv- 
alent observables and products defined for equivalence classes. In fact, the mapping 
A{t) — >• Ah{t) is not necessarily invertible on the space of all observables A{t). 
This follows from the simple observation that already the map (2.10) contains in- 
tegrations. Two different integrands (observables) could lead to the same value of 
the integral (operator) for arbitrary fixed boundary values ip{T — |), ip{T + |). It 
is therefore possible that two different observables A„(r) and Aii{r) can be mapped 
into the same Hcisenberg operator Ah{t). Since the expectation values can be com- 
puted from Ah{t) and p only, no distinction between < Aa > and < A^ > can then 
be made for arbitrary p. All local observables A{t) which correspond to the same 
operator Anir) arc equivalent. 

We are interested in structures that only depend on the equivalence classes of 
observables. Addition of two observables and multiplication with a scalar can simply 
be carried over to the operators. This is not necessarily the case, however, for the 
(pointwise) multiplication of two observables. If A^ir) and Ah{T) are both mapped 
into Ah{t) and a third observable B(r) corresponds to Bh{t), the products Aa ■ B 
and Aij ■ B may nevertheless be represented by different operators (cf. eq. (5.20), 
(5.22)). It is then easy to construct states where < AaB >^< Ai^B > and the 
pointwise product docs not depend only on the equivalence class. 

On the other hand, the (matrix) product of two operators AhBh obviously refers 
only to the equivalence class. It can be implemented on the level of observables by 
defining a unique "standard representative" of the equivalence class as 

A[p,t\^F[Ah{t)\ (6.1) 

Using the mapping A[t] —>■ Ah{t) (2.10), (5.1), (5.5), we define the quantum product 
of two observables as 

A{ip, t) o B{<p, r) = F[Ah{t)Bh{t)] = {A o B)[ip, r] (6.2) 

This product is associative, but not commutative. (By definition, the operator 
associated to the observable (^4 o B){(p,T) is Ah{t)Bh{t) and the product Ao B 
is isomorphic to the "matrix multiplication" AB if restricted to the subspace of 
operators A = F[A],B = F[B].) The correlations (e.g. expectation values of 
products of observables) formed with the product o refiect the non-commutative 

to better "smoothened" observables. 
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structure of quantum mechanics. This justifies the name "quantum correlations" . 
Nevertheless, we emphasize that the "quantum product" o can also be viewed as 
just a particular structure among "classical observables" . 

The definition of the quantum product is unique on the level of operators. On the 
level of the classical observables, it is, however, not yet fixed uniquely by eq. (6.2). 
The precise definition obviously depends on the choice of a standard representation 
F[Ah{t)] for the equivalence class of observables represented by Ah- We will choose 
a linear map FfctiAij i + a^iAH,-^ — ctiFfAij i] + Q;2F[Aij 2] with the property that 
it inverses the relation (5.13). For "time-ordered" ti < T2 < ...r^ the map F should 
then obey 

i^[/n(Q(T„)).../2(g(T2))/l(g(Ti))] = /i((^(Ti))/2(</.(T2)).../n(<^(T„)). (6.3) 

It is easy to see how this choice exhibits directly the noncommutative property of 
the quantum product between two observables. As an example let us consider the 
two observables </?(ti) and </'(r2) with ti < T2. The quantum product or quantum 
correlation depends on the ordering 

V7(r2) O V9(ri) = i^{T2)^{Ti) 

^(ri)o^(r2) = ^(r2)^(ri) + F[[g(ri),Q(r2)]] (6.4) 

The noncommutative property of the quantum product for these operators is directly 
related to the commutator 

[Q(ti), g(T2)] = lJ-\n)QU{n,T2)QU{T2) 

-U-\r2)QU{T2,n)QU{n) (6.5) 

Only for time-ordered arguments the quantum correlation coincides with the clas- 
sical correlation. The nonvanishing commutator (p{Ti) o ip{T2) — <^(t2) o (^(ti) could 
presumably play a crucial role in the discussion of Bell's inequalities [4] once our 
system is extended to a setting with more than one particle. ^ 

The map F can easily be extended to operators involving derivatives of (p. We 
concentrate here for simplicity on a translation invariant probability distribution in 
the local region with constant Z{t) — Z. The mappings (with T2> Ti + e) 

F(i?(r)) = -Zd>cp{T) 
F{R{t)Q{t)) = -Zpir)d>pir) 

F{R{T2)R{n)) = Z^d><f{T2)d><f{n) (6.6) 

are compatible with eq. (6.3). This can be seen by noting that the r-evolution of 
Q{t) according to eq. (5.12) implies for e — the simple relation 

drQjr) ^ [H, Q(t)] = -Z-'R{r) (6.7) 

^Not c that Bell's inequalities are based on the definition of the correlation function by "pointwise 
multiplication" . 
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A similar construction (note [Q{t + e), Q{t)] ~ —^/Z) leads to 

F{R'{t)) = Z'{d>cp{T)f - Z/e (6.8) 

and we infer that the quantum product of derivative observables at equal sites differs 
from the pointwise product 

d>^{T) o d>^{T) = {d>^{T)r - l/{eZ) (6.9) 

Prom the relations (6.4) and (6.9) it has become clear that the difference between 
the quantum product and the "pointwise" classical product of two observables is 
related to their r-ordering and "overlap" . Let us define that two observables Ai [ip] 
and A2[^p] overlap if they depend on variables (/^(r) lying in two overlapping r-ranges 
TZi and 7^2- (Here two ranges do not overlap if all r in TZi obey r < Tq whereas for 
7^.2 one has r > Tq, or vice versa. This implies that non-overlapping observables can 
depend on at most one common variable (^(tq).) With this definition the quantum 
product is equal to the classical product if the observables do not overlap and are 
r-ordered (in the sense that larger r arc on the left side). 

In conclusion, we have established a one-to-one correspondence between classical 
correlations (^(t2)(^(ti) and the product of Heisenberg operators Q{t2)Q{ti) provided 
that the r-ordering T2 > Ti is respected. This extends to observables that can be 
written as sums or integrals over (/^(r) (as, for example, derivative observables) 
provided the r-ordering and non-overlapping properties arc respected. For well 
separated observables no distinction between a quantum and classical r-ordered 
correlation function would be needed. In particular, this holds also for "smoothened" 
observables Ai that involve (weighted) averages over (/?(r) in a range TZi around r^. 
Decreasing the distance between r2 and ri, the new features of the quantum product 
^1(^2) o show up only once the distance becomes small enough so that the 

two ranges TZi and 7^2 start to overlap. In an extreme form the difference between 
quantum and classical correlations becomes apparent for derivative observables at 
the same location. Quite generally, the difference between the quantum and classical 
product is seen most easily on the level of the associated operators 

A10A2 MM 

Ai-A2 T{AiA2) (6.10) 

Here T denotes the operation of r-ordering. The r-ordered operator product is com- 
mutative T(iii2) = T{A2Ai) and associative T{T{AiA2)A^) = T{AiT{A2A3)) = 
T{AiA2As). As we have seen in the discussion of the derivative observables, it lacks, 
however, the general property of robustness with respect to the precise definition of 
the observables. This contrasts with the non-commutative product A1A2. 
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7 Complete classical statistics, irrelevant and in- 
accessible information 



Our discussion of incomplete classical statistics may perhaps have led to the impres- 
sion that the quantum mechanical properties are somehow related to the missing 
information. This is by no means the case! In fact, our investigation of the conse- 
quences of incomplete information about the probability distribution was useful in 
order to focus the attention on the question which information is really necessary to 
compute the expectation values of local observables. We can now turn back to stan- 
dard "complete" classical statistics where a given probability distribution j9[y9(r)] is 
assumed to be known. We concentrate here on a general class of probability distri- 
butions which can be factorized in the form p = j5>poP< according to eq. (1.1) - it 
may be called "factorizable" or "F-statistics" . For example, all systems which have 
only local and next-neighbor interactions are of this form. Within F-statistics the 
states remain defined according to eq. (2.9). 

We emphasize that any additional information contained in p[Lp] which goes 
beyond the local distribution poM and the states {ip} and {ipl does not change a iota 
in the expectation values of local observables and their correlations! The additional 
information is simply irrelevant for the computation of local expectation values. A 
given probability distribution specifies p< andp> uniquely. This determines 1-0} and 
{ipl and we can then continue with the preceding discussion in order to calculate 
the expectation values of local observables. The precise form of p< and p> which 
has led to the given states plays no role in this computation. 

Since all information contained in p< and p> beyond the states \tp} and {tp\ 
is irrelevant for local expectation values, it is also inaccessible by any local mea- 
surements. In fact, even the most precise measurements of expectation values and 
correlation functions for arbitrarily many local observables could at best lead to 
a reconstruction of the states and This sheds new light on the notion 

of "incompleteness" of the statistical information discussed in this note. In fact, 
within F-statistics the "incomplete" information contained in the states l'^} and 
{ipl constitutes the most complete information that can possibly be achieved by 
local measurements! Since any real measurement is local in time and space all as- 
sumptions about information beyond the states concern irrelevant and inaccessible 
information and cannot be verified by observation! 

Particularly interesting in the spirit of the completeness question asked by Ein- 
stein is the following situation: Suppose first that an observer has no information 
about the "exterior region" beyond the one contained in the state vectors. Never- 
theless, his information is sufficient in order to compute the expectation values and 
correlations of all local observables. What happens, however, if additional informa- 
tion about the probability distribution in the exterior region becomes available? Our 
observer could now perhaps compute additional expectation values for observables 
with support outside the local region. As far as the local observables are concerned, 
however, the additional information is completely irrelevant. In this sense quantum 
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mechanics is complete as far as local observables are concerned. 

These simple remarks have striking consequences: all the quantum mechani- 
cal features found in our discussion of incomplete classical statistics are genuine 
properties of all classical statistical systems whose probability distribution can be 
factorized. This concerns, in particular, the expectation values of the observables 
(P^{t). For an arbitrary r-translation invariant and factorizable probability distri- 
bution all < (P^{t) > will be independent of r unless the translation symmetry is 
spontaneously broken. We infer that only the discrete stationary values of < > 
of the quantum-mechanical system with the appropriate H are possible solutions. 
We see how "quantum mechanical" information can be used directly for a discussion 
of classical statistical properties in a wide class of systems. 

Another possibility concerns the use of the uncertainty relation which is also 
present in classical F-statistics. Assuming for simplicity a discrete symmetry (f — > 
—if with < (f >— this yields the inequality (cf. the definition (5.20)) 

< ^\t) >< Ap2{t) >=< g2 >< p2 ;l/4 (7.1) 

(Throughout this paper we use conventions for the units of (/? and r where ^ = 1.) 
It is not obvious how such an inequality for the derivative-like observable Ap2 (5.20) 
would have been found without using the simple commutator relations of quantum- 
mechanical operators. The simple fact that quantum-mechanical information can be 
used in practice to establish properties of expectation values in a standard classical 
statistical system demonstrates in a simple way that quantum-mechanical features 
are indeed genuine properties of classical statistical systems. 

The quantum correlation between two observables can be formulated in standard 
classical statistics as well. Together with the "classical" correlation function we 
have thus more than one candidate for the definition of a correlation function in a 
given classical statistical system^. The final decision which correlation is relevant in 
practice depends on the question which type of correlation can typically be measured 
by experiment. We believe that a certain "robustness" of the correlation with respect 
to the precise choice of the observable plays an important role in this respect. 

We have argued in the preceding section that the classical correlation may be dis- 
favored by the lack of robustness for local correlations of local derivative operators. 
The observed disease of the classical correlation gets weakened, however, once we 
consider the average of a correlation < A{ti)B{t2) > over a certain range in |r2 — ri|. 
With the mappings from observables to Heisenberg operators (for e — >^ 0, Z{t) = Z) 

dMr + e)dMr) - ^^(r + e)R{T) = -^P^(r) 

dMr + e)dMr) = - (7-2) 

^Actiially, the same situation would arise had we started from a quantum-mechanical system: 
one has to decide if the noncommuting operator product AB or rather the commuting r-ordered 
product T{AB) should be used for the definition of the correlation. 
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we see that the difference between the two versions of derivative operators vanishes 
for an average of classical correlations which is defined by 



^ ^ < dMr + me)dMT) > (7.3) 

m=— 1 

Similarly, for A = (2n + l)e we may define averaged observables 

^^(r) = ^ E A{r + en) (7.4) 

m=—n 

and we find for the difference of the square of the two versions of derivative operators 

(a>(^)^(r)(a>(^)^(r) - {dripnr){dr^nT) ^ ^ (7.5) 

For fixed A this vanishes for e — > and one may incorrectly conclude that the 
problem of the lack of robustness for classical correlation functions disappears for 
smoothened or averaged observables. 

That this is not the case can be realized by the comparison of two other smoothened 
derivative observables 

OMr) = + (7.6) 

It is straightforward to verify that both (d^ip)^ and {pr^)^ actually correspond to 
the observable d^^p up to corrections 0{e) whereas for a discussion of the robustness 
problem on the scale A we should compare two versions of derivative observables 
that may differ in order 0(A) as the two versions in eq. (7.6): 

d^>^{T) -i%)+0(A) 

~dMr) - -|^(r)+0(A) (7.7) 

Nevertheless, the classical correlation function differs for the two choices by a term 
that does not vanish for A — 0: One finds, for |A < if > | <^ 1 and T2>t\: 

a? >^(r2)a,^>»>(r:) - 9? (r2)a,^^(T,) 

- ^Z^^OfA _ _ _ ^-|^;y^') ,(2A - (X. - r,)) (7.8) 

In contrast to eq. (7.5) this difference survives in the continuum limit e — 0. 
Furthermore, for T2 = Ti it "diverges" again for small A as 1/(2 AZ). We conclude 
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that the lack of robustness of the classical correlation remains present for averaged 
observables as well! 

To be more precise, we will formulate the following "robustness criterion" for 
meaningful correlation functions: if two smoothened observables with support in a 
T-range of the order 0(A) have equal expectation values for all probability distribu- 
tions up to corrections ~ 0(A), then the respective correlation functions should 
also become identical up to corrections ~ 0(A). (Here it is understood that 
|A < ^ > I <S 1.) Form eq. (7.8) we learn that the classical correlation does not 
meet this robustness criterion. For example, for T2 near ri the difference between 
the correlation for the two versions of the derivative operator "diverges" ~ A~^. In 
fact, this disease extends to a whole range of (t2 — ti) ~ 0(A). On the other hand, 
the quantum correlation obeys the robustness criterion by construction. 

This discussion opens an interesting perspective: The difference between clas- 
sical and quantum statistics seems to be a question of the appropriate definition 
of the correlation function. Simple arguments of robustness favor the choice of the 
quantum correlation! In a sense, the successful description of nature by quantum- 
mechanical operators and their products gives an "experimental indication" that 
quantum correlations should be used! 



8 Superposition of states and density matrices 

A fundamental principle of quantum mechanics is the superposition of states. It 
states that for two quantum states \ip'''^^) and [tp'^'^^) the linear superposition [tp) = 
ai\ip^^^) + a2\'4'^'^^) is again a possible quantum state. (Proper normalization is 
assumed.) Furthermore, for two density matrices p^^^ , p^^^ the linear combination 
p — Wip^^^ + W2P^^\ Wi + W2 — 1, is again a possible density matrix if it obeys the 
appropriate positivity conditions. We will show that these properties arise naturally 
in our context of incomplete classical statistics (or, more generally, F-statistics) , at 
least for a restricted choice of a 1, 0^2 • 

Let us consider two probability distributions p*^^-*[<^] = exp{—S^^^[(p],p^'^^[Lp] = 
exp(— 5"^^^ [</?]) which differ only outside the local range — f < r < f, i.e. 

sS^iv] + St\\ , S'^l\^\ + St\^\ (8.1) 

Within the local range the two probability distributions correspond to the same 
dynamics 

E^^\t) = H^^\t), U^^\t) = t/(2)(r) (8.2) 
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whereas the states IV'*-^-*} and \ip^'^^ differ. We will assume that both and 
5"^^^ are invariant under the reflection symmetry. As far as local observables are 
concerned the corresponding operators are the same for both situations. The only 

difference in the expectation values of observables between the two ensembles can 
be traced back to different state vectors at some reference point Tq or time to- This 
setting reflects precisely the situation for two different quantum mechanical states 

\Mto)) + |^2(to)). 

A superposition state corresponds to a new probability distribution given by 
S\^p\ = Sq\^p\ + S>\^p\ + S<\^p\ with 

exp(-5>[<^]) = aiexp(-5i^)[(^]) + (x^^-^^{-S^^\^\) (8.3) 

Here the real coefficients a\ and a2 have to obey the condition that exp(— S'[</9]) is 
positive semidefinite for all and properly normalized. The definition (2.9) of the 
states as functional integrals implies directly 

|V'(f)} = ai|V'(^)(f)} + a2|V'^'HT)} (8.4) 

We observe that the superposition is compatible with the evolution such that for all 
T in the interval — f < r < f one finds \i>{T')') — q;i|'0^^^(t)} + 0L2\i)'^^^ {r')') . We con- 
clude that quantum mechanical superposition arises directly from the construction 
of the probability distribution (8.3). In particular, we emphasize the appearance of 
interference in the computation of expectation values of operators 

+aiO;2((V'^'V^'^^IV'^'^) + {^^^^\A(^^\^^'^)) (8.5) 

The interference terms ~ aia2 are characteristic for "quantum statistics". In our 
approach they are connected to the fact that the probability distribution corre- 
sponding to (8.3) cannot be written as a sum of two probability distributions! It 
should be emphasized that ai and a2 may have opposite sign such that interference 
may indeed be destructive. Nevertheless, the condition stipulated after cq. (8.3) 
does not admit arbitrary superpositions. We note that the linear structure of the 
Schrodinger equation and the quantum mechanical time evolution arise directly from 
the basic construction. Nonlinear generalizations of quantum mechanics would have 
to modify this structure. 

In distinction to the construction (8.3) we can also consider linear combinations 
of probability distributions 

This alternative construction does not lead to interference and results in a linear 
combination of density matrices (cf. eq. (5.2)) 

p = wip^^^ + W2P^'^^ (8.7) 
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with 

(A) = Tr (ip) = wiTr(ip(^)) + W2Tt{Ap^^'^) (8.8) 

The density matrix p (8.7) is not anymore the density matrix corresponding to a 
pure quantum mechanical state. In particular, the "pure state density matrices" 
p(i)^p{2) obey 

Tr(p«)2 = Tr(p«) = 1 (8.9) 

whereas (for Wi ^ 0) 

Trp2 = w2Tr(p(i))2 + ^2r,n^(p(2))2^2u)iw;2Tr(pWp^^^) 

= 1 + 2M;iW2(Tr(p(^V^'^) - Trp^^^Trp^^)) ^ i. (8.10) 

We emphasize that the probability distribution (8.6) cannot be written in the 
product form (1.1) any more. The linear combination of density matrices therefore 
generalizes our original concept of incomplete statistics. This contrasts to the super- 
position of states (8.3) which preserves the product structure (1.1). For an extended 
concept of incomplete statistics with probability distributions of the type (8.6) new 
possibilities for r-independent < ^P{t) > arise, corresponding to stationary density 
matrices in quantum mechanics. 



9 Conclusions and discussion 

Within a simple example of classical statistics for coupled unharmonic oscillators on 
a chain we have formulated a description in terms of states and operators in anal- 
ogy to quantum mechanics. The state vectors and the operators can be expressed 
in terms of classical functional integrals. Typical quantum mechanical results like 
the relations between the expectation values in stationary states or the uncertainty 
relation can be taken over to the classical system. Our procedure inverts the con- 
struction of the Euclidean path integral for a quantum mechanical system in the 
ground state or thermal state, with a generalization to a wider class of states. 

The introduction of "quantum mechanical" operators associated to every local 
classical observable allows us to define equivalence classes of observables which can- 
not be distinguished by any measurement of their expectation values. We argue that 
the definition of the correlation function should be consistent with this equivalence 
structure. We require that indistinguishable observables must lead to the same cor- 
relation function. This leads to the introduction of a quantum correlation within the 
classical statistical setting. We point out that the quantum correlation constitutes a 
more robust definition of the correlation function with respect to the precise details 
of the definition of observables, both for classical and quantum statistical systems. 
The basic conceptual distinction between quantum statistics and classical statistics 
disappears in this respect. We have also seen the emergence of typical characteris- 
tics of quantum statistics like the superposition of states and interference. All this 
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points into the direction that it may be possible to understand the mysteries of the 
basics of quantum mechanics within a formulation of a classical statistical problem 
with infinitely many degrees of freedom. 

What is missing is an understanding how the complex structure of quantum me- 
chanics - the important phases - could be rooted in a possible classical statistical sys- 
tem. For our present system we discuss in the two appendices that a complex struc- 
ture can be defined, if the system is invariant under a refiection symmetry. There 
we introduce a description in terms of normalized complex state vectors \ip{t) > 
which depend on a real-time variable t. The time evolution is then given by the 
Schrodinger equation idt\ip >= H\%Ij > with a hermitean Hamilton operator (3.11). 
Expectation values of observables can be computed from associated operators in the 
usual way, e.g. 

< >=< V|<5> > (9.1) 
These operators obey the usual commutation relations, e.g. 

[Q,P^] = 2R , [Q,R] = -1 (9.2) 

where R plays the role of iP. As familiar in quantum mechanics we can equivalently 
use a Heisenberg or Schrodinger picture for the computation of the time evolution 
of expectation values of observables. 

We observe, nevertheless, that at the present stage several insufficiencies remain 
on our way of understanding quantum mechanics from a classical statistical formu- 
lation. A major problem concerns the restriction that our description of states as 
functional integrals is restricted to those states |^/'(t)) whose analytical continuation 
I'^(t)} for t — —IT is a real positive function. Similarly, we have so far dealt only 
with hnear superpositions q;i|'0^^^) + Q;2|V'^^^) with restricted real coefficients ctj such 
that the sum is again a real positive function. This situation seems deeply related to 
the issue of the complex structure and the important unsolved questions concerning 
the analytic continuation and the role of time. 

The quantum mechanical features discussed in this note are present in all clas- 
sical statistical systems. However, their conceptual meaning has become particu- 
larly clear in our formulation of incomplete classical statistics. The approach to 
incomplete statistics can be extended in various directions. First of all, incomplete 
statistical information does not necessarily occur in the form of missing information 
outside a local range. For example, the incompleteness of the information about the 
probability distribution can also concern the resolution within a given local interval. 
This problem probably takes a direction which is qualitatively very different from 
our development of quantum mechanics. Within the context used in this paper we 
may impose the additional restriction that only information which survives in the 
continuum limit e — > is available. Otherwise stated, the resolution is not arbi- 
trarily accurate. As discussed in the beginning of sect. 6 the different derivative 
observables become indistinguishable in such a version of incomplete statistics. 

One can also investigate the consequences of abandoning certain of our assump- 
tions. Without the reflection symmetry 9 we obtain a description which remains 
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similar to quantum mechanics in many aspects. The Hamilton operator H does not 
remain hermitean, however, and the evolution operator U is not unitary any more 
(after analytic continuation). Without translation symmetry in r we expect to find 
non-zero expectation values of antihcrmitean operators. We have not explored what 
happens if the interactions go beyond next-neighbor interactions. Finally, our ap- 
proach can be extended to a collection of variables (Pa{T)- If we interpret a as a 
momentum label, we find a straightforward generalization to quantum field theory. 

At this stage it is still open if the constructions presented here will find some 
practical use. Also the crucial question if quantum mechanics can indeed be formu- 
lated within a classical statistical system with infinitely many degrees of freedom 
has not yet found a definite answer. We hope that the finding of several structures 
characteristic for quantum mechanics within a classical statistical formulation will 
encourage the continued exploration in this direction. 

Acknowledgment : 

The author would like to thank M. Liischer for useful discussions. 



Appendix 

A Reflection symmetry and complex structure 

We have found several quantum-mechanical features in a classical statistical system, 
including the characteristic non-commutativity of operator products. In a sense, the 
quantum-mechanical and classical descriptions can be viewed as dual descriptions 
of one and the same system, distinguished by the choice of the correlation function. 
This raises the question if the other characteristic features of quantum mechanics, 
as the complex structure and the unitary time evolution, can also be found within 
classical statistics. In the two appendices we show that these structures may indeed 
be present on a formal level. So far we have not found, however, a fully consistent 
description of the quantum mechanical phases within our classical statistical setting. 

Quantum mechanics has an intrinsic complex structure. This is manifest in 
the Schrodingcr equation. In this section we establish how this complex structure 
emerges from a reflection symmetry in (incomplete) classical statistics. Let us con- 
sider the reflection^ at a given reference point r — 0, i.e. 



^Existence of the reflection for every r requires that for every variable <p(r) there is also a 
variable r). 




(A.l) 
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We concentrate on reflection-invariant probability distributions [9] 

9{C{t)) = C{-t) 

^(5>(r))=5<(-r) (A.2) 

for which = '^-t{v)i Zj. = Z_r- The corresponding transformation properties 

of the states are 

e\^{r)} = {^{-t)\ , e{^{T)\ = m-r)} (A.3) 

We define the action of 6 on matrices such that it also involves a transposition in 
the sense that 6'({-?/'i|A|-?/'2}) = ^|'^2}(^^)6'{'0i|- Using the definitions of p, U, H and 
the operators A one finds the relations 

9p{T) = p^(-r) , eAnMr) = ii?£(-r), 

eH{T) - H^{-t) , 9U{t2, ti) = C/^(-Ti, -T2) (A.4) 

Here A^/^^ is related to As by replacing in eq. (2.10) for A[ip{T + 'r])_s^^^s] any 
(f{T + 77) by (/9(r — 77), corresponding to a reflection of A[y9,r] at r. In consequence 
of the reflection symmetry of the probability distribution, the expectation value of 
any local observable must be equal to the one of the reflected observable 

e < A{t) >-< A^'^\-r) >=< A{t) > (A.5) 

On the other hand, the reflection (A.l) acts on only by a variable charge, 

i.e. 

^|V(<^(t); r} = |V'(<^(-t)); r} = {V(<^(-t)); -t| (A.6) 

Interpreting and {-01 as functions of two variables (p and r (without distinction 
to which T the variable (p was originally associated) we can write 

m-r)}^Wr)\ (A.7) 

and similarly 9{p{t)) = p{t) etc., or 

p^(-r)=p(r) , A^''^^{-r)^A{r), 
H'^{-t) = H{t) , C/^(-ri, -rs) = C/(t2,ti) (A.8) 

We note that the invariance of the functional integrals It/)}, {V'l, p, f/, ^5 follows gen- 
erally from the possibility to reverse the transformation (A.l) by a variable sub- 
stitution. In contrast, the relations (A.3), (A.4) involve the invariance properties 
(A.2). 

So far, all quantities have been real. We will now introduce a complex struc- 
ture by considering two classes of functions of r (including operators), namely those 
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which are either even or odd in r. Even functions are considered as real, whereas the 
odd ones are purely imaginary. This relies on the isomorphism between a pair of real 
functions {feven, fodd) and the subclass of the complex functions z — Re z + i Im z, 
where Re z is even and Im z is odd, i. e. {Re z,i Im z) <->■ {feven, fodd)- Com- 
plex conjugation is then equivalent to {fodd ~^ —fodd)- Equivalently, the complex 
conjugation changes the sign of r and we define its action as 

mr)r = m-r)}, Wr)r = M-r)|, 

p{t)* = p(-r), H{t)* = H{-t) 
U{T2,n)* = U{-T2,-n), A{r)*^A{-T) (A.9) 

Combining this definition with the action of the reflection 9 (cf. eqs. (A. 7), (A. 8)) 
we recover well-known properties of quantum mechanics, namely 

mr)r = Wr)l p\t)^p{t), H\t) ^ H{t) 
U\T2,n) = C/(ti,T2) = C/-'(t2,ti) (A.IO) 

With respect to this complex structure the reflection 9 acts as hermitean conjugation. 
The euclidean time r itself is odd and should therefore be considered as an imaginary 
quantity, r = it, t real. The self-consistency of this prescription is apparent by 
noting that for a wave function \ip{ip; t)} = e^^'^il)Q{ip) {E and ipo real) the complex 
conjugate reads {il}{ip;T)\ = \ip{Lp;r)}* = {e^'-^^)*ijjo{(p) = e*'^Vo(9') = e^'^i'o{'-p) = 
|'0(</7; — r}. We note that |V'(0)} = {'0(0)1 and p — are real. 
For an arbitrary operator A we deflne 

A^'\r) = l[A{r)+A(^\r)) , A('^\t) = ^- [A{r) - A^^\r)) (A.ll) 

Prom eqs. (A. 8), (A.9) one finds A'^^^t) = A'i{t) and we conclude that A^'') is 
hermitean and A^^'^ antihermitean 

i Wt (r ) = i W (r) , (^) ^ (^) (A. 12) 

In compatibility with eq. (A. 5) we conclude that all antihermitean operators must 
have purely imaginary expectation values. We emphasize that there is no a priori 
reason why antihermitean operators should not be associated with obscrvables. In 
the sense of the original definition (2.5) their expectation values arc simply odd 
with respect to the refiection of r. The refiection symmetry alone does not enforce 
such expectation values to vanish. The situation is different for simultaneous r- 
translation and reflection symmetry where in addition < A{—r) >—< A{r) >. In 
this case the expectation values of all odd observables or antihermitean operators 
vanish. 

In conclusion, the discrete reflection symmetry introduces the complex structure 
characteristic for quantum mechanics: complex state vectors, hermitean density 
matrices and a hermitean Hamiltonian. The translation in r is described by a 
unitary evolution operator. 
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B Analytic continuation 



The definition of a complex conjugation as an involution in the space of r-dependent 
functions does not yet specify the complex structure completely. In addition, we have 
to define the multiplication with complex numbers and the complex multiplication 
of functions. This is most easily done by constructing a mapping from the space 
of real functions of r to the space of complex functions where the operations of 
complex conjugation and complex multiplication are implemented in the standard 
way. We will see that the analytic continuation of all functions \'iP{t)}, A{t) etc. 
constitutes a map with all required properties once t — it is considered as a pure 
imaginary variable. 

We first show that analytic continuation of the functions of interest is indeed 
possible in the limit of continuous r (e ^ 0). With 

{d/dT2rU{r„n) = i-H{r2)rU{T„n), 

{d/dnyu{T2,n) = U{T2,n){H{n)y (B.i) 

existing for all p, and Ti the evolution operator IJ (r2, ri) is analytic both in T2 and 
Ti. In turn, |^(r)}, {iP{t)\ and A{t) are analytic functions of r. As an example, we 
may represent |^(t)} as a Taylor series with real coefficients a,n{ip), i.e. r)} = 

^^Qa„((^)r". Similarly, the symmetric and antisymmetric combinations read 

\Ur)} = \mr)} + \^{-T)}) 



m=0 m=0 

\Ur)} = \mr)}-\i^{-r)} 
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E a2m+i{vy'^^' = i Y^i-lTa^m+Mt''^^' (B.2) 



m=0 m=0 



One sees that the complex conjugation (A. 9) is compatible with the analytic con- 
tinuation of the real function |'?/'(t)} for r it. The descriptions in terms of the 
original real functions \iP{t)} = |'?/'s(t)} + \'ipa{'T)} or the complex wave functions 
= lipsiit)} + lipaiit)} are completely equivalent - they are simply related to 
a change of variables. We repeat, however, that the use of the complex structure 
related to r-reflection necessarily implies that r must be purely imaginary. (Real 
values for r are not compatible with this complex structure and should be used 
only in the language employed originally where all quantities are real. Obviously, 
the meaning of the word "real" depends on the complex structure used to distin- 
guish between real and imaginary numbers. In absence of a complex structure all 
quantities are trivially "real" .) 
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The complex multiplication of two functions \ijji{it)} and \ip2{'it)} is equivalent 
to the (real) multiplication of I'lpiir)} and |^2(t)} in the original language 



mr)} = |V'i(t)}|V'2(t)} ^ |V3(^^)} = |Vl(^^)}|V'2(^^)} (B.3) 

This is a direct consequence of the compatibility of analytic continuation with the 
product of two complex functions. The multiplication law (B.3) extends to matrix 
products Ai{it)A2{it) or U{it2,iti)\ip{iti)}. In the following we will always use the 
complex structure with the complex multiplication and adopt the notation 

m) >= mu)}, < m\ = mt)\ = m-u)} = m) >* 

U{t2, h) = Uiit2, ih), A^'^^t) = Aiit) (B.4) 

In other words, \ip{t) > is the analytic continuation of the functional integral |'?/'(t)} 
given by eq. (2.9). In particular, for an exponentially decreasing \ip{r)} = e~-^'^Vo 
the state vector |'0(i) >= e~'^*Vo is an oscillatory complex function of t. We note 
that U is unitary 

U^{t2,ti)U{t2,h) = 1 (B.5) 
and the time evolution conserves the norm of the complex state vector 

<^(t)||^(t)>={^(r)||^(r)} = l (B.6) 

We associate the variable t with time and recover the Schrodinger equation (cf. 
(3.2)) 

idt\ip >= H\i) > (B.7) 

At this point we should remark that our one-dimensional classical statistical sys- 
tem with next-neighbor interactions (1.1) has not a priori an interpretation as a 
description of a time evolution. In fact, one possibility is to view this system as a 
chain in space in equilibrium. In this case it describes infinitely many interacting 
degrees of freedom and there is no time evolution. The quantum mechanical dis- 
creteness is present, nevertheless, as well as the description in terms of operators 
and the possibility to introduce a complex structure. We have seen in appendix A 
that we can define operators and correlation functions in dependence on a complex 
parameter rj — e*"i, e.g. 

Qh{v) = e*""^ Q e-'^" (B.8) 

Using the complex language (which is not familiar in this context) the relevant 
correlation functions for a chain in space correspond to purely imaginary rj. Actually, 
the concepts of distance and geometry (in this case trivial) can be constructed from 
the r^-dependence of the correlation function without assuming a space interpretation 
a priori [8] . 

A different interpretation of the probability distribution (1.1) concentrates on 
expectation values and correlations for real t]. In this case rj can be considered as a 
time parameter and our system describes the quantum-mechanical time evolution of 
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a single degree of freedom (not infinitely many as for the space interpretation). We 
emphasize that this interpretation is not characterized by a given deterministic time 
evolution equation. The concept of time arises from the "transport of information" 
between neighboring regions ("time regions" in this case) and is itself of a proba- 
bilistic nature! In this sense we may consider the dynamics of quantum mechanics 
as the result of an interpretation of time as a particular structure among observables 
in a classical statistical system. 

Our definition of a complex structure within incomplete statistics allows the 
computation of expectation values of time- dependent observables A(t) for a range 
of complex values of t. (The imaginary part of t should be within the local region 
|t| < f introduced in the formulation of our problem.) Although suggestive, it 
is not apparent in the present framework why our interpretation of the real world 
concentrates on real values oi t. At the present stage it is not obvious why the 
values of the correlation functions at imaginary values of r (real t) are much more 
important than their values of real r. We believe that a satisfactory answer to these 
questions will shed more light on the basic origins of quantum mechanics and time. 

If r becomes a complex variable we may also consider analytic continuation di- 
rectly in the functional integral. This can easily be achieved by choosing a purely 
imaginary e in eqs. (2.2) and (2.4). Such a prescription brings us, however, to a path 
integral with phases for which the positivity of exp(— S*) and therefore the classical 
probabilistic interpretation is lost. On the other hand, we could now release the 
restriction that the analytic continuation of \ip{t) > leads to a positive real function 
|'?/'(t)}, opening the possibility to describe excited states. At the present stage we 
have not yet succeeded to overcome this conflict between the phases of quantum 
mechanics and the probabilistic interpretation of exp —S. It seems worthwhile to 
investigate if there could exist more complex statistical systems for which the an- 
alytical continuation from euclidean to real time is consistent with a probabilistic 
interpretation. 

References 

[1] A. Einstein, B. Podolski, N. Rosen, Phys. Rev. 47 (1935) 777 

[2] S. Weinberg, Phys. Rev. Lett. 62 (1989) 485 

[3] G. 't Hooft, gr-qc/9903084 

[4] J. S. Bell, Physical 1 (1964) 195 

[5] R. P. Feynman, Rev. Mod. Phys. 367 (1948) 20; Phys. Rev. 80 (1950) 440 

[6] J. Zinn- Justin, Quantum Field Theory and Critical Phenomena, (Oxford Uni- 
versity Press 1996); S. Weinberg, The Quantum Theory of Fields, (Cambridge 
University Press 1995) 



32 



[7] C. Wetterich, Nucl. Phys. B314 (1989) 40 

[8] C. Wetterich, Nucl. Phys. B397 (1993) 299 

[9] K. Osterwalder, R. Schrader, Comm. Math. Phys. 31 (1973) 83 



33 



